GENERIC POINTS IN SYSTEMS OF SPECIFICATION AND 
BANACH VALUED BIRKHOFF ERGODIC AVERAGE 

AI-HUA FAN, LING-MIN LIAO, AND JACQUES PEYRIERE 

Abstract. We prove that systems satisfying the specification property are 
saturated in the sense that the topological entropy of the set of generic points of 
any invariant measure is equal to the measure-theoretic entropy of the measure. 
We study Banach valued Birkhoff ergodic averages and obtain a variational 
principle for its topological entropy spectrum. As application, we examine 
a particular example concerning with the set of real numbers for which the 
frequencies of occurrences in their dyadic expansions of infinitely many words 
are prescribed. This relies on our explicit determination of a maximal entropy 
measure. 



1. Introduction 

By dynamical system {X, T) , we mean a continuous transformation T : X —^ X 
on a compact metric space X with metric d. We shall adopt the notion of topological 
entropy introduced by Bowen ([9], recalled in the section 2), denoted by /itop, to 
describe the sizes of sets in X. We denote by Ai^nv the set of all T-invariant 
probability Borel measures on X and by Mcrg its subset of all ergodic measures. 
The measure-theoretic entropy of /i in A^inv is denoted by ft,^. 

Let us first recall some notions like generic points, saturated property and the 
specification property which are quite known in dynamical systems nowadays. 

For /I G A^inv, the set of ^i-generic points is defined by 

I J 

where stands for the weak star convergence of the measures. 

A dynamical system (X, T) is said to be saturated if for any fi G Mim, we have 
^top(G^) — hfj_. 

Bowen ([8]) proved that on any dynamical system, we have htopiGp,) < hp, for any 
j-i G A^inv So, saturatedness means that G^ is of optimal topological entropy. One 
of our main results is to prove that systems of specification share this saturatedness. 

A dynamical system {X, T) is said to satisfy the specification property if for any 
e > there exists an integer m(e) > 1 having the property that for any integer 
k > 2, for any k points xi, . . . ,Xk in X, and for any integers 

ai < bi < 02 < b2 < ■ ■ ■ < Ok < bk 
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with Ui ~ bi-i > m{e) (V2 < i < k), there exists a point y & X such that 
d{T"-'+"y, T"x,) < e (V < n < 6^ - a^, VI < z < fc). 

The specification property was introduced by Bowen ([8]) who required that y is 
periodic. But the present day tradition doesn't require this. The specification prop- 
erty implies the topological mixing. Blokh ([7]) proved that these two properties are 
equivalent for continuous interval transformations. Mixing subshifts of finite type 
satisfy the specification property. In general, a subshift satisfies the specification if 
for any admissible words u and v there exists a word w with |u>| < fc (some constant 
k) such that uwv is admissible. For /3-shifts defined by Tpx = I3x{ mod 1), there is 
only a coimtable number of /3's such that the (3 shifts admit Markov partition (i.e. 
subshifts of finite type), but an uncountable number of /3's such that the /3-shifts 
satisfy the specification property ([27]). 

Our first result is stated as follows. 

Theorem 1.1. If the dynamical system {X,T) satisfies the specification property, 

then it is saturated. 

As application, we study Banach- valued Birkhoff averages for saturated systems. 
Let B be a real Banach space and B* its dual space, their duality being denoted 
by (•,•). We consider B* as a locally convex topological space with the weak star 
topology cr(B*,B). For any B*-valued continuous function $ : X ^ B*, we consider 
its Birkhoff ergodic averages 

n — 1 

An^x) = - V <^(T^x) (n > 1). 

j=o 

We would like to know the asymptotic behavior of An^{x) in the a{M* , B)-topology 
for different points x G X. 

Let us state the problem we are studying as follows. Fix a subset ii^ C B. For a 

E 

sequence {^„} C B* and a point ^ G B*, we denote by limsup^^^^ < C the fact 
limsup(^„, ti;) < {^,w) for all w G E. 

n— ^oo 

The meaning of "=" is obvious. It is clear that limsup„^oQ ^„ < ^, or equivalently 

limsup„^oQ = ^, means ^„ converges to ^ in the weak star topology cr(B*,B). 
Let a e B* and E cM. The object of our study is the set 

f E 

Xi^{a; E) = -ix G X : limsup A„$(a;) < a 

n—^co 

The set X^{a; B) will be simply denoted by X^{a). This is the set of points x € X 

such that lim„^oo An^{x) = a in cr(B*,B)-topology. If E denotes the convex cone 
of E which consists of all aw' + bw" with a > 0, 6 > and w' € E, w" G E, then 
X$(q;, E) = X$(q;, E). So we may always assume that E is a, convex cone. If E is 
symmetric in the sense that E = —E, then we have 

X^{a, E) = \ x G X : lim An^{x) = a] . 

By entropy spectrum we mean the function 

£|(a) :=htop{X^{a;E)). 
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Invariant measures will be involved in the study of the entropy spectrum £^{a). 
We set 



where / ^d/j. denotes the vector- valued integral in Pettis' sense (see [26]) and the 

E 

inequality " <" means 



(^,w)diJ, < {a,w) for all w G E. 

For saturated systems, we prove the following variational principle. 

Theorem 1.2. Suppose that the dynamical system {X,T) is saturated. Then 

(a) If M<s>{a;E) ^ (I), we have X^{a,E) =^. 

(b) If M^{a;E) ^ 0, we have 

htop{Xq,{a; E)) = sup h^. (1.1) 

neM^{a;E) 

When B is a finite dimensional Euclidean space and i? = M'', the variational 
principle (1.1) with E = R'^ was proved in [15, 16] for subshifts of finite type, then 
for conformal repellers ([17]) and later generalized to systems with specification 
property [28]. There arc other works assuming that $ is regular (Holder for exam- 
ple). See [6, 14] for classical discussions, [2, 3, 20, 21, 23, 29] for recent developments 
on Birkhoff averages, and [1, 5, 10, 12, 4] for the multifractal analysis of measures. 

The study of infinite dimensional Birkhoff averages is a new subject. We point 
out that [24] provides another point of view, i.e. the thermodynamical point of 
view which was first introduced by physicists. 

The above variational principle (1.1), when = B, is easy to generalize to the 
following setting. Let ^' be a continuous function defined on the closed convex hull 
of the image ^{X) of $ into a topological space Y. For given ^, and /? G we 
set 

X|(/3) = \xGX : lim *(^„$(a;)) = p] 

and 

Mlif3) = |/x G TWinv : * (^y"$(i/x^ = /3 

We also set 



XiiP) = {xeX : ^ (j.im_ A„$(x)) = /?} = |J X$(a). 

a: *(a)=/3 

It is clear that X^{(3) is a subset of X^{(3). 

Theorem 1.3. Suppose that the dynamical system {X,T) is saturated. Then 

(1) ifMtiP) = %, we have X|(/3) = 0, 

(2) z/7W|(/3) ^ 0, we have 

/itop(X|(^)) =fttop(x|(/3)) = sup h^. (1.2) 

This generalized variational principle (1.2) allows us to study generalized ergodic 
limits like 
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where g : X ^ M+ is a continuous positive function. It suffices to apply (1.2) to $ 
replaced by ($, g) and \I' defined by ^{x, y) = x/y, with a; G B* and y & R+. 

It also allows us to study the set of points x € X for which the limits A^o^ix) = 
lim„^oo A.n^{x) verify the equation 

^{A^^x))^p. (1.4) 

The present infinite dimensional version of variational principle would have many 
interesting applications. We will just illustrate the usefulness of the variational 
principle by the following study of frequencies of blocks in the dyadic development 
of real numbers. It can be reviewed as an infinitely multi-recurrence problem. 

Let us state the question to which we can answer. All but a countable number 
of real numbers t £ [0, 1] can be uniquely developed as follows 

* = E^ (in e {0,1}). 

Let fc > 1. We write 0*^ for the block of k consecutive zeroes and we define the 
0"-frequency of t as the limit (if it exists) 

fit, k) = lim -H{1 <j<n: t^t^+i ■ ■ ■ t,+k-i = O'^}. 

n — >oo n 

Let (ai, 02, • • • ) be a sequence of non-negative numbers. We denote by >S'(ai, 02, • • • ) 
the set of all numbers t € [0, 1] such that f{t, k) = Uk for all fc > 1. As a consequence 
of the variational principle ( 1.1), we prove 

Theorem 1.4. The set S{ai,a2,- ■ ■) is non-empty if and only if the following 

condition is satisfied 

1 = ao > ai > 02 > . . . ; - 2ai+i + ai+2 > (i > 0). (1.5) 
If the condition (1.5) is fulfilled, we have 

00 

htoT>{S{ai, a2, ■■■)) = -/i(l - ai) + X] ^^""i ~ ^(^j+i + «j+2) (1-6) 

3=0 

where h{x) = — xlogx. 

Furthermore, it is proved that there is a unique maximal entropy measure, which 
is completely determined (see Lemma 5.6). 

The paper is organized as follows. In the section 2, wc give some preliminaries. 
In the section 3, we prove Theorem 1.1. In the section 4, we prove the theorems 1.2 
and 1.3 and examine the case where B = 1^{Z). In the section 5, we apply the 
variational principle (1.1) to the study of the recurrence into an infinite number of 
cylinders of the symbolic dynamics. Especially, we study the set of orbits whose 
recurrences into infinitely many cylinders are prescribed. This relies on the explicit 
determination of a max;imal entropy measure which, by definition, max;imizes the 
supremum in (1.1). 

2. Preliminary 

Before proving the main theorems, we wish to recall the notions of topologi- 
cal entropy, the Bowen lemma and two propositions about the measure-theoretic 
entropy. 
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Recall that X is a compact metric space with its metric d and that T : X ^ X 
is a continuous transformation on X. For any integer n > 1 we define the Bowen 
metric d„ on X by 

dn{x,y) = max d(T^ x,T^y). 

0<j<n 

For any e > 0, we will denote by Bn{x, e) the open d„-ball centered at x of radius 
e. 



2.1. Topological entropy and Bowen lemma. 

Let Z c X he & subset of X. Let e > 0. We say that a collection (at most 
countable) R = {S„.(a;i, e)} covers Z if Z c [J^ Bmixi, e). For such a collection R, 
we put n{R) = minj rij. Let s > 0. Define 

Hn{Z, e) = inf ^ exp(-sni), 

i 

where the infimum is taken over all covers R oi Z with n{R) > n. The quantity 
H^{Z, e) is non-decreasing as a function of n, so the following limit exists 

H%Z,e)^ lim K{Z,e). 

n — *oo 

For the quantity H^{Z, e) considered as a function of s, there exists a critical value, 
which we denote by /i.top(^, e), such that 



^ ' ' \ 0, s>htop{Z,e). 



One can prove that the following limit exists 

htop{Z) = lim/itop(-^, e)- 

€—►0 

The quantity htop{Z) is called the topological entropy oi Z ([9]). 

For a; e X, we denote by V[;x) the set of all weak limits of the sequence of 
probability measures SJJo^ ^nx- It is clear that V(x) ^ and V{x) C A4inv 
for any x. The following Bowen lemma is one of the key lemmas for proving the 
variational principle. 

Lemma 2.1 (Bowen [8]). For t > 0, consider the set 

B^*^ ={xeX :3iJ,e V{x) satisfying h^<t}. 

Then /itop(B(*)) < t. 

Let /i G A^inv be an invariant measure. A point x £ X such that V{x) = {fi} is 
said to be generic for /z. Recall our definition of G^, we know that is the set of all 
generic points for /x. Bowen proved that hiopiG^) < for any invariant measure. 
This assertion can be deduced by using Lemma 2.L In fact, the reason is that 
X G implies /U € V{x). Bowen also proved that the inequality becomes equality 
when fjb is ergodic. However, in general, we do not have the equality htop{G^) = 
(saturatedness) and it is even possible that G^ = 0. Cajar [11] proved that full 
symbolic spaces are saturated. Concerning the /U- measure of G^, it is well known 
that n{Gfj,) = 1 or according to whether /x is ergodic or not (see [13]). 
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2.2. Two propositions about the measure-theoretic entropy. 

We denote by C{X) the set of continuous functions on X, hy Ai = A4{X) the 
set of all Borel probability measures. 

In the sequel, we fix a sequence {pi)i>i such that pi > for all i > 1 and 
J2^iPi = 1 (for example, pi = 2~' will do). Suppose that s„ = {sn,i)i>i {n = 
1, 2, • • • ) is a sequence of elements in £°°. It is obvious that s„ converges to a = 
{<^i)i>i € i°° in the weak star topology (i.e. each coordinate converges) is equivalent 
to 



lim > Pi\snA - ai\ = 0. 

n—^oo ^ — ' 
i=l 

We also fix a sequence of continuous functions {$i,$2, • • •} which is dense in the 
unit ball of C{X). Write $ = ($i, $2, ■ • •)• I* is evident that ^ : X ^ i°° is 
continuous when is equipped with its weak star topology. Fix an invariant 
measure £ Minv Let 

a = (ai, a2, • • • aj, ■ • • ) where ai = J ^idji. 

The set of generic points can be described as follows 

Gf, = \x&X: lim Vpi - a^] = I = X^{a). (2.1) 

It is well known that the weak topology of M. is compatible with the topology 
induced by the metric 



d{li,v) =^^Pi / ^idjj,- / ^idv 

i=l 



(2.2) 



where both {pi)i>i and {^i}i>i are chosen as above. 
The following two results will be useful for us. 

Proposition 2.2 (Young [31]). For any fi £ A^inv and any numbers < S < 1 and 
< < 1, there exist an invariant measure v which is a finite convex combination 
of ergodic measures, i.e. 

r r 

1/ = ^ AfeZVfe, where Afe > 0, ^ Afe = 1, i^k & A^erg, r e N+ 

fe=i fe=i 

such that 

d{^i, u) < S, hv>h^ — 9. 

This is a consequence of the following result due to Jacobs (see [30], p. 186). 
Let n S M.in\ be an invariant measure which has the ergodic decomposition n = 
Jj^ rdn^T) where tt is a Borel probability measure on yWerg- Then we have 



Proposition 2.3 (Katok [18]). Let n £ Alerg be an ergodic invariant measure. For 
e > and 6 > 0, let r„(e, 6, fj) denote the minimum number of e-balls in the Bowen 
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metric dn whose union has /i-measure more than or equal to 1 — 6. Then for each 
d > we have 

ha = lim limsup — logr„(e, 5, (jl) = Km liminf — logr„(e, S, /u). 

In [18], it was assumed that T : X ^ X is a, homeomorphism. But the proof in 
[18] works for the transformations we are studying. 

3. Systems with specification property are saturated 

In this section, we prove Theorem 1.1 which says that every system satisfying 
the specification property is saturated. Because of Bowcn's lemma (Lemma 2.1), 
we have onfy to show /itop(G^) > /i^. The idea of the proof appeared in [15, 16] and 
was developed in [28]. It consists of constructing the so-called dynamical Moran 
sets which approximate the set of generic points G^. 

3.1. Dynamical Moran sets and their entropies. 

Fix e > 0. Let {mfc}fc>i be the sequence of integers defined by ruk = m{2~^e) 
which is the constant appeared in the definition of the specification property (fc = 
1,2,.. .). Let {Wk}k>i be a sequence of finite sets in X and {nk}k>i be a sequence 
of positive integers. Assume that 

< (x, y) > be (Vx, y&Wk x^y). (3.1) 

Let {A^fe}fe>i be another sequence of positive integers with A''i = 1. Using these 
data, we arc going to construct a compact set of Cantor type, called a dynamical 
Moran set, which will be denoted by = F{e, {Wk}, {uk}, {Nk})- We will give an 
estimate for its topological entropy. 
Denote 

Mk = j^Wk. 

Fix fc > 1. For any Nk points xi,--- ,XNk in M^fe i-e- (a^i,-'' ^xn^) G '^k'' ^ 
choose a point y{xi, • • • , xn^) S X, which does exist by the specification property, 
such that 

<(a;„T»»y)<^ (s = 1, . . . , iV^) (3.2) 

where 

as = [s- l){nk + mk). 
Both (3.1) and (3.2) imply that for two distinct points (a;i, • • • ,XNk) and (Si, • • • ,XNk) 
in W^*' we have 

dtkivi^i^-- ,XNj,y{xi,--- ,xn^,)) > 4e (3.3) 
where tk = + nk, i.e. 

tk = {Nk - l)mk + NkUk- 

In fact, let y = y{xi, • • • , xn^) and y = y{xi, ■ ■ ■ , xn^)- Suppose Xg 7^ Xg for some 
s e {I,-- - ,Nk}. Then 

dt,{y,y) > dr,,{T'''y,T-^y) 

> drik {xs,Xs) - dn^{xs,T'^'y) - duk {xs , T"-' y) 

> 5e-e/2-e/2 = 4e. 

Let 

D^ = Wu Dk = [y{xu--- ,XN,):{xu--- ,XN,)&W^''] (Vfc > 2). 
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Now define recursively Lk and £k as follows. Let 

Li = Di, £i = Til. 

For any x & Lk and any y G Dk+i [k > 1), by the specification property, we can 
find a point z{x, y) G X such that 

deM^^y),^) < dt,^,{T'''+"^>'+^z{x,y),y) < 

We will choose one and only one such z{x,y) and call it the descend from x & Lk 
through y G Dk+i ■ Let 

Lk+i = {z{x,y) : X € Lk,y e Dk+i} , 

fc+i 

4+1 = ik + mk+i+tk+i= Nini+^Ni{mi + ni). 

4 = 2 

Observe that for any x G Lk and for all y,y E Dk+i with y ^ y, we have 

de,{z{x,y),zix,y)) <^ (fc > 1), (3.4) 

and for any x,x G Lk and y, y E -Dj +i with {x, y) ^ {x, y), we have 

dtk+i{z{x,y),z{x,y)) > 2,e (fc > 1). (3.5) 

The fact (3.4) is obvious. To prove (3.5), first remark that d(,^{z,z) > 5e > 4e 
for any z,z E Lx with z ^ z, and that for any x,x € Lk and y,y E Dk+i with 
{x,y) 7^ {x, y) we have 

dik+Az{x,y),z{x,y)) > de^{x,x) - di^{z{x,y),x) - de^{z{x,y),x) 

and 

dlk+Az{x,y),z{x,y)) 

> dt,^, {y, y) - dt,^, iT'-+"^^+^z{x, y), y) - dt,^, iT'-+"^''+^ z{x, y), y). 

Now using the above two inequalities, we prove (3.5) by induction. For any x,x G Li 
and y,y E D2 with either x ^ x or y ^ y, we have 

di^{z{x,y),z{x,y)) > 4e - ^ - ^ = 4e - ^. 

Suppose we have obtained that 

e e e 



dedzix,y),z{x,y)) > 4e ■ 



2 22 2'=-i' 
Then for any x, x E Lk and y,y E Dk+i with (x, y) ^ (5, y) we have 

di,.,{z{x,y),z{x,y)) > 4e - J - 



2 2^ 2''^""'^ 2''^"'""'^ 2*'"'""'^ 

e e e e 

= ^^~2~22 2^^ ~ ^ > 
Now define our dynamical Moran set 



F = F{e, {Wk}, {uk}, {Nk}) = fl Fk, 

where 



fe=i 



Fk= \J B,,{x,e2-^^-'^) 
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{B{x, r) denoting the closed ball of center x and radius r). The set F is Cantor-like 
because for any distinct points x' ,x" G Lk, by (3.5) we have 

B4(a=',e2-('=-i))n:B,,(a.",e2-('=-i)) = 

and if 2; e ifc+i descends from a; e Lfc, by (3.4) we have 

B,,^,{z,e2-'^)^B,,{x,e2-('^-'^). 

Proposition 3.1 (Entropy of F). For any integer n > 1, let k = k{n) > 1 and 
< p = p{n) < A^fe+i he the unique integers such that 

4 + p{mk+\ + nfe+i) <n<lk + {p+ l){mk+\ + nfe+i). 

We have 

htop{F) > lim inf - (iVi logMi + --- + Nk log Mk+p log Mk+i). 

n— '■oo fl 

Proof. For every > 1, consider the discrete measure concentrated on 

It can be proved that crfc converges in the week star topology to a probability 
measure a concentrated on F. Moreover, for sufficiently large n and every point 
x G X such that Bn{x, e/2) n F 7^ 0, we have 

a(i?„(x,e/2)) < = m^....mN,mI^^- 

(see [28]). Then we apply the mass distribution principle to estimate the entropy. 

□ 

3.2. Box-counting of G^. 

Recall that a = (Q!i)i>i G £°° and $ = ($,) is a dense sequence in the unit ball 
of C{X). For 5 > and n > 1, define 

X^{a,6,n) ^ i^xeX : Y^pi\An^i{x) - ai\ < . 

For e > 0, let iV(Q:, S, n, e) denote the minimal number of balls Bn{x, e) to cover the 
set X^{a,d,n). Define 

A$(a) := lim lim lim sup — log A''(a, S, n, e) (3.6) 

By the same argument in [15] (p. 884-885), we can prove the existence of the limits, 
and the following equality: 

A$(a) = lim lim lim inf — log A''(a, 5, n, e). 

Proposition 3.2. A$(a) > h^. 

Proof. It suffices to prove A$(a) > — 46 for any ^ > 0. For each i > 1, define 
the variation of $t by 

var($i,e)= sup \^i{x) - ^i{y)\. 

d{x,y)<e 
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By the compactness of X and the continuity of $i, hnie^o var((l>i, e) 0. So 



+00 



lim V'pivar($j, e) 0. 

e— >0 ^— ' 



i=l 



This, together with (3.6), allows us to choose e > and 5 > such that 



+00 



and 



limsup — \ogN{a, 5^, n, e) < K^{a) + 9. 



(3.7) 



(3.8) 



For the measure /i, take an invariant measure v — Yl\=\ ^kt^k having the prop- 
erties stated in Proposition 2.2. For 1 < fc < r and N >1, set 



Yk{N) = ja; e X : ^n$i(a;) - J <S>^diyk 



<S (Vn > N) 



Since Vk is ergodic, by the Birkhoff theorem, we have 



lim Pi 



i=0 



-/■ 



= ffe— a.e. 



(3.9) 



Then by the Egorov theorem, there exists a set with z/fe-measure greater than 1—9 
on which the above limit (3.9) is uniform. Therefore, if N is sufficiently large, we 
have 

j^kiYkiN)) > 1 - 9 (Vfc = I,--- ,r). (3.10) 
Apply the second equality in Proposition 2.3 to the triple (i'fe,4e, ^) in place of 
(y(i, e, S). When e > is small enough, we can find an integer N). = Nk{yki^^, 9)>1 
such that 

r„(4e, 9, Vk) > exp(n(/i^^ - 9)) (Vn > Nk). 
This implies that if n > Nk, then the minimal number of balls _B„(a;,4e) to cover 
Yk{N) is greater than or equal to exp{n{h„i, —6)). Consequently, if we use C(n, 4e) 
to denote a maximal (n, 4e)-separated set in Yk{N), then 

#C(n, 4e) > exp(n(/i,, - 9)) (Vn > Nk). (3.11) 

Choose a sufficiently large integer A^o such that 

nfc := [Xkn] > max(iVi, ■■■ ,Nk,N) (Vfc = 1, . . . , r; Vn > Nq) 

([•] denoting the integral part). By the specification property, for each r points 
Xi G C(ni,4e), . . . ,Xr & C(nr,4e), there exist an integer m(e) depending on e and 
a point y = y{xi, . . . , Xr) & X such that 

dn,{T'"'y,Xk) <e (l<fc<r) (3.12) 

where 

fc-i 

Oi = 0, afe = (A: — l)m + ns (A: > 2). 

s=l 

Write h = ttr + rir, i.e. 

r 

n= {r — l)m + n^. 
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We claim that for all such y — y{xi, . . . , Xr), wc have 

y = y{xi, . . . , Xr) G X,s,{a, 5(5, h) (3.13) 

when n is sufficiently large, and that for two distinct points {xi, . . . , x^) and {x'l, . . . , x'^.) 
in C(ni,4e) x • • • x C(nr,4e), the points y = y{xi, . . . ,Xr) and y' = y{x[, . . . ,x'j.) 
satisfy 

ch{y,y')>2€. (3.14) 

If we admit (3.13) and (3.14), we can conclude. In fact, the balls Bn{y,e) are 
disjoint owing to (3.14) and hence there are #C(ni,4e) x ... x i^C{nr,^e) such 
balls. Therefore, because of (3.13), the minimal number of (n, e)-balls needed to 
cover X^{a,f)6,n) is greater than the number of such points t/'s. That is to say 

iV(a, 5(5, n, e) > #C(ni, 4e) x . . . x #C{nr, 4e) 

Then by (3.11), we get 



N{a,h5,h,e) > exp^[Afen](/i^^ -6). 



k=l 



By noticing that 



[Afcn] 



Afe as n ^ 00 and Yl\=i = 1, we get 



lim inf — log N{a, 56, h, e)>h^ — 36 

n — *oo 71 

This, together with (3.8), implies A,p{a) > /i^ — 49. 

Now return to prove (3.13) and (3.14). The proof of (3.14) is simple: suppose 
Xk 7^ x'f. for some 1 < k < r. By (3.12), 

dn{y, y') > dn, {T-^-y, T'^'^y') > (a;fc, 4) - 2e > 4e - 2e = 2e. 

Now prove (3.13). Recall that oii = J <^idv and v = ^k'^k- We have 



\Af,^i{y) - a,\ < 



An<^i{y) -Y^^Xk j ^tdi^k + J ^^dv~ j 



Since d(/x, v) < 5 i.e. Yl'iLi Pi \ / ^idjJ' — J ^idv\ < S, we have only to show that 



fe=l 



< 4(5. 



(3.15) 



Write 



r [Afcra]-1 r Ofc-l 

AnMy) = E MT'"'+'y) + ^Yl E 



fc=l j=0 



n 



k=2 j=ak —rn 

r ttfc-l 



E^AA.nl$.(T-y)H-iE.E ^'^^ 



fe=l 



fe=2 j=afe— m 



Then 



An^i{y)-Y^Xk I <^idu, 
fe=i 



</l(i)+/2(i)+/3(i)+/4(i) 
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with 



hii) 
h(l) 
hii) 
hii) 



E 

k=i 

r 

E 

fc=i 

r 

E 

fe=i 



[XkTl] 



[Afen] 



[Afcr 



At 



Ofc — 1 



-J ' "•fc ^ 

-EE 

Since [A^n] < Afcfi and a;fe satisfies (3.12), by (3.7) we get 



'^Pihii) < ^Pi^>^kya.vi^i,e) = ^ptva.ii^i,e) < 5. 

i=l i=l fe=l i=l 

Since a;^; G ifc(iV) and [Afen] > A^, we have 

oo oo r „ 

^Pihii) < E^^E^*^ '^lXkn]^i{Xk) - / ^idUk 

i=l i=l fe=l •' 

r oo „ r 



fe=l 

Since ||$i|| < 1, we have 



1=1 



;c=i 



^ft/3(i) < 

i=l 

oo 

E^^^^4(^) < 



[Afen] 



fc=i 

{r-l),u{c) 



OO 

^Pi 

i=l 



(r-lj/z/^f) 



< (5 



when n is sufBciently large because n — > oo and 



Afe. 



By combining all these estimates, we obtain (3.15). □ 

3.3. Saturatedness of systems with specification. 

In this subsection we will finish our proof of Theorem 1.1, which says that systems 
satisfying the specification property are saturated. It remains to prove htopiG/j,) > 
A<i,{a). In fact, by Proposition 3.2, we will have /itop(G^) > hf^. On the other hand, 
it was known to Bowen [8] that > /itop(Gju). So, we will get htop{G^) = h^. 

Proposition 3.3. /itop(G^) > Ag,{a) 

Proof. It suffices to prove /itop(G^) > A<i,(q;) — for any 9 > 0. To this end, we will 
construct dynamical Moran subsets of = X$(q;), which approach X^{a). The 
construction is based on separated sets of Xg,{a, S, n). 

Let TOfe = m(2~'^e) be the constants in the definition of specification. By the 
definition of A$(q;) (see (3.6)), when e > is small enough there exist a sequence of 
positive numbers {Sk} decreasing to zero and a sequence of integers {nfe} increasing 
to the infinity such that 

nfe > 2"*= (3.16) 
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and that for any k > 1 we can find a (rifc, 5e)-separated set Wk of X^{a,dk,nk) 
with 

Mk := Wk > exp(nfe(A$(a) - 9)). (3.17) 
Choose a sequence of integers {Nk} such that 

iVi = 1 (3.18) 
iYfc > 2"''+i+'"'=+i, k>2 (3.19) 

Nk+l > 2^i"i+^=("2+m2)-+JVfe(nj,+mO^ > 1 (3 20) 

Consider the dynamical Moran set F = F(e, {Wfe}, {nk}, {-^fe}) as we constructed 
in the last subsection. From (3.16)-(3.20), we get 

liminf-(iVilogMi + • • • + TVfe logM^ + plogM^+i) > A^{a) - 9. 

n— »cx> n 

By Proposition 3.1, we have 

htopiF) > A$(a) - 9. 
Thus we have only to prove F C X^{a). Or equivalently 

^ oo 

lim -y^p,\S„^i{x) -nai\=0 {x G F). (3.21) 

n — >QO Ti — ^ 

4 = 

Let us use the same notations as in the last subsection including £k , tk , Dk and 
Lk etc. 

Fix n > 1. Let fc > 1 and < p < Nk+i be the integers, which depend on n, 
such that 

4 + pijUk+i + rife+i) < n < 4 + (j5 + l)(TOft+i + Ufe+i) 

Write 

g = n - (4 +p(TOfe+i + rife+i)), 6s = (s - l)(mfc+i + Uk+i). 
Decompose the interval [0,n) (c N) into small intervals 

[0,n) = [0,4)|J[4,4 +p(TOfc+i + rifc+i)) [J[4 +p(TOfe+i +nfc+i),n) 

and decompose still [i'fc,4 +nfe+i)) into intervals alternatively of lengths 

Uk+i and mk+i- Then cut the sum X^o<j<ra ^»(^''^) ^^^^^ sums taken over small 
intervals. Thus we get 

\Sn^i{x) - nail < Ji{i) + J^2(i) + J3(«) + Ji{i) 



where 



Ji(i) \Si^<^^(x) - lkai\ 

V 

Mi) = X]|5m,+i*i(T^'=+''x)-mfe+iai 



s=l 



^3(i) = ^|5„,+,$i(T^'=+'''+™'=+^a;)-n,+iai| 



s=l 



J4(i) = |s'g$i(r^'=+P(™''+i+"'=+i'a;) -gai 
Since < 1 (hence |Q!i| < 1), we have 

J2{i) < 2pmk+i, Ji{i) <2q< 2{mk+i + rik+i). 
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By (3.19), we have 

^ OO ^ CX) 

lim - Vpi J2(j) = 0, lim - VpiJ4(i) = 0. (3.22) 

i=0 1=0 

Now let us deal with Ji{i) and Jaii). We claim that for any x £ F there exists 
a,n X € Lh such that 

dikix,x)<^^, (3.23) 
and that for all 1 < s < p, there exists a point Xg S M^fc+i such that 

dr,,^,{x,,T^'x)<^ (3.24) 

where 

Us = £k + bs + TOfe+i. 

In fact, by the construction of F, there exists a point z G ife+i such that 

de,+Az,x)<^. (3.25) 

Assume that z descends from some x G Lk through y G -D^+i. Then 

diAx,z)<^ (3.26) 

and 

dt,^,(y,T^'=+'"'=+^^)<^. (3.27) 

On the other hand, according to the definition of D^+i, there exists an Xs G Wk+i 
such that 

<^,(x,„r^-?y)<^. (3.28) 

Now by the trigonometric inequality, the fact de^ {z, x) < di^_^_^ {z, x) and (3.25) and 
(3.26) we get 

,_ , e e e 

dpi,(x,x] < — TT-r H r < — ; — 

'^k\ J J — 2^+1 2^ 2 

Thus (3.23) is proved. By (3. 25), (3. 27) and (3.28), we can similarly prove (3.26): 
dn,+, {xs,T^'x) < {xs,T'^y) + {T'^y, T^'z) + (r"=z, T^'x) 

< dn,^, (x, , T^'-y) + dt,^, {y, T^'=+™'=+i z) + {z, x) 

e e e 

^ 2fe+i ^ 2'=+! ^ 2*^ 

e 



2fc-i- 

It is now easy to deal with J3(i), which is obviously bounded by 
p p 

Xs) - rife+iaj . 

s=l s=l 

Using (3.24), wo obtain 

\Sn,+,Mxs) - 5„,+i$i(T"=a;)| < nfc+ivar($i, e2-('=-i)). 
On the other hand, since Xs G Wk+i C X$(q;, J^+i, nfe+i), we have, by definition. 



y^Pi |'S'nfc+i*i(a;s) -nfe+iai| < nfe+i(5fe+i. 



1=1 
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Then, combining the last three estimates, and using the facts Y^'^iPj = 1 and 
mk+i < n, we get 



^ oo oo 

Since k can be arbitrarily large, we finally get 

^ oo 

Urn -y"piJ3{i)=0. (3.29) 

i=l 

Now it remains to prove 

1 °° 

Hm - VftJi(i) = 0. (3.30) 

i=l 

Observe that 

Ji{i) < \Se,Mx) - Se^^^{x)\ + \Se^^,{x) - ika^\ . 
By (3.23), we have \S^^^^{x) - Se,^^i{x)\ < 4var($i, e2-('=-i)). Then 
Ji{i) < 4var($i,e2-('=-i)) + Rk,i 

where 

Rk,i = max \Se^^i{z) - £kai \ . 

Since var($i, e2~^''~^^) tends to zero as fc ^ oo, the desired claim (3.30) is reduced 
to 

^ OO 

lim - ypiRk,i = 0. (3.31) 

i—1 

We need two lemmas to estimate RkA- 
Lemma 3.4. For any y G -Dfc+i? have 

■CO 

|S'tfe+i$i(y) - tk+iai\ 

i=l 
oo 

< ^ftiVfc+infc+ivar($i,e2-('=+i)) + 2{Nk+i - l)mfe+i + iVfc+infc+i(5fc+i. 
Proof. For any s = 1, . . . , Nk+i, there exists Xg & Wk+i such that 

nb. 



e 



dn,+AxsX'y) < 1^ (3.32) 
where hg = {s — l){mk+i + rik+i)- Write 

Nk+i Nk+i-1 



s—1 8= 

Then 

Nk+1 Nk+1-1 
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Since Xs G Wk+i ^ X$(q!, (5fe+i, nfc+i), by (3.32), we have 

oo 



i=l i 

oo 

^p,nfe+ivar($„e2-('=+i)) 



i=l i=l 

oo 

< 

i=l 

On the other hand 



Now it is easy to conclude. □ 
Lemma 3.5. 

oo oo fe k k 

Y,PiRk,i < 25^pi5^^,var($i,e2-^) + 2^Ar,m,- 

i=l i=l j=l j=l j=l 

Proof. We prove it by induction on k. When A; = 1, we have Lx = Di = W\ C 
X$ {a,5i,n\) and then 

oo 

'^PiRi^i < ni5i = £iSi. 

Suppose the lemma holds for k. For any z G Lfc+i there exist x £ and y € Dk+i, 
such that 

Write 

Then \Sei^_^_^^i{z) — £k+ioii\ is bounded by 

\Si,^iiz) - 4ai| + ISr^^^.^iiT^'z) - mk+iai\ + \St,^,^i{T^>'+""'+^ z) - tk+iai\ . 
Notice that 

|%$i(^)-4ai| < \Si,<S>dz) - Se,<i>,{x)\ + \Se,'^i{x) - ikail 
< 4var($i,e2-('=+i)+iifc,i, 

\Sm^_^^^i{T^'' z) - mk+iai\ < 2mk+i 

and 

< I ^t,^, (r^.+™.+i ^) _ St,^, (y) I + I ^t,^, (y) - 4+iai I 

< tfc+ivar($i,e2-('=+i)) + - tfc+iai| . 
By Lemma 3.4, we have 

oo oo OO' 

Yp,Rk+\,i < ^PtRk,, + Ypi{ik + 4+1 + A^fe+infc+i)var($i, e/2'=+^) 
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Then according to the induction hypothesis the Lemma holds for fc + 1, because 
(-k + tk+i < ik+i, Nk+mk+i < ik+i- 

□ 

Let us finish the proof of Theorem 1.1 by showing (3.31). Since nj > 2"*^ , we 
have 

^tH- < , — T = — ^ (i ^ oo)- 

Then the estimate in Lemma 3.5 can be written as 

oo k 

i=l j=l 

where cj {j ^ oo). By (3.20), we have (k > S^''-^ It follows that 

^ OO ^ k—1 

— ^PiRk,^ < Cfc + ^ Cjij. 
i=l i=l 

This implies (3.31). □ 

4. Variational principle 

In this section, wc prove variational principles for saturated systems (Theo- 
rem 1.2 and Theorem 1.3). 

4.1. Proofs of Theorems 1.2 and 1.3. 

The proof of Theorem 1.3 is similar to that of Theorem 1.2. 
Proof of Theorem 1.2 (a). It suffices to prove that if there exists a point x G 
X^{a;E), then Mi,{a;E) ^ 0. That x S X^{a\E) means 

limsup(A„$(a;), < (q,w) (Vw e E). (4.1) 

n— >oo 

Let /U be a weak limit of Y^^Zo ^tjx- That is to say, there exists a sequence rim 
such that 

lim — ^ f{T^x) = / /rfM (4.2) 

for all scalar continuous functions /. We deduce from (4.1) and (4.2) that for all 
w £ E we have 



/ 



{^,w)dfj,= lim {An^^{x),w) < limsup(A„$(a;), w) < {a,w). 



So /X G M^{a; E). 

Proof of Theorem 1.2 (h). Let t — sup^g^^^^.^-, h^. What we have just proved 
above may be stated as follows: if a; e X^{a] E), then 

V{x) C M<s>ia;E). 
It follows that < t for any /i G V{x). Thus 

X^{a]E) C {x G X : V /X G V{x) satisfying < t} 
C {x G X : 3 ^ G V{x) satisfying h/^ <t} . 
Then, due to Lemma 2.1, we get htop{X^{a; E)) < t. 
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Now we prove the eonverse inequality. For any 6 ^A<^,{a^,E)^ consider the 
set of generic points. We have 

C X^{a;W) c X^{a;E). 

The second inclusion is obvious and the first one is a consequence of the fact that 
X € G fx implies liniyj_^QQ = a in the (T(B*,B)-topology. Thus 

Since fi is an arbitrary invariant measure in M-<s>{a;E), we can finish the proof 
because the system {X,T) is saturated (i.e. /itop((?^) = h/^). □ 

It is useful to point out the following facts appearing in the proof: 

(i) If X G X^{a,E), then V{x) C M.s>{a,E). 

(ii) We have 

U G^cX^{a,E)c U G^ 

with Gfi = {x & X : V{x) 3 fi}. It is worth to notice the fact that all the are 
disjoint. 

It is clear that M.^{a, E) is a compact convex subset of the space A^inv of Borel 
probability invariant measures. If ft,^, as a function of /i, is upper semi-continuous on 
A^inv, then the supremum in the variational principle is attained by some invariant 
measure, called the maximal entropy measure in A1$(q!, .B). Usually, the structure 
of A^$(a, E) is complicated. But it is sometimes possible to calculate the maximal 
entropy. 

Proof of Theorem 1 . 3. Let x € X^ (/?) and let /x be a weak limit of n~ ^ X)j=o ^to x ■ 
Then there exists a subsequence of integers {rim} such that tends to J ^d\i 

in the weak star topology as to ^ oo because we have an expression similar to (4.2) 
with f = {^,w) (w e IB being arbitrary). Hence 

* f / ^dn] = lim ^{An^^x)) = lim *(A„$(a;)) = p. 

\J I m— »oo n— >oo 

Thus we have proved that [i € A^f (/?). That is to say 

y(a;) c A^|(/3) (Vx e X|(/3)). 
It follows that (a) holds and that due to Lemma 2.1 we have 

hi.oA^t{&)) < sup h^,. 

The converse inequality is a consequence of the variational principle (1.1) and 
the relationship 

XK/S) D 1|(/?) = U X^{a). 

In fact, 

/itop(^|(/3)) > /itop(^|(/3)) > sup /itop(^*(a)) 

a:'I'(a)=/3 

= sup sup 

= sup /l^. 
A»e>i|(/3) 
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4.2. £^(Z)-valued ergodic average. 

Let us consider the special case where B = i^{Z). Then B* = e°°{Z). Any 
(Z)-valued function <I> can be written as 

<^{x) = {^n{x)) with sup|$„(a;)| < 00. 

n 

Recall that £°°(Z) is equipped with the cr(^°°, ^i)-topology. A £°°(Z)-valued func- 
tion <E> is continuous if and only if all coordinate functions '■ X —>■ M. are contin- 
uous, because for any w — {wn)nez E wc have 

nez 

Let us give an application of the variational principle in this setting. Let / 
be a finite or infinite subset of positive integers. Let {$i}ig7 be a family of real 
continuous functions defined on X. We suppose that sup^gj ||^j||c(x) < oo- For 
two given sequences of real numbers a = {aj}ig/ and b = we denote by 

^(a, b) the set of points x & X such that 

tti < \im ini An^i{x) < limsup^„$i(x) < bi (Vi G J). 

Corollary 4.1. Suppose that the system {X,T) is saturated. The topological en- 
tropy of S{sl, b) defined above is equal to the supremum of the measure-theoretical 
entropies for those invariant measures /z such that 

Proof. For n G Z, let e„ be the n*^ clement of the canonical basis of ^^(Z). Lot $ be 
a function whose nth coordinate and — n**^ coordinate are respectively equal to $„ 
and — 3>n for each n E I (other coordinates may be taken to be zero). Take the set 
E C i^, which consists of and e_j for i E I. Take a E £°° such that a_i = — 
and ai = bi for i E I. Now we can directly apply the variational principle by 
noticing that 

Ci) = e-i) = {i E I). 

□ 

The result contained in this corollary is new. oven when I is finite. If I is finite 
and if = bi for i E I, the preceding corollary allows one to recover the results in 
[16] and [28]. 

The validity of the variational principle is to some extent equivalent to the fact 
that the system {X, T) is saturated. 

Theorem 4.2. Let (X. T) be a com,pact dynamical system. The system is saturated 
if and only if the variational principle (Theorem 1.2 (b)) holds for all real Banach 
spaces B. 

Proof. It remains to prove that the variational principle implies the saturation of 

the system. 

Take a countable set {/i}ieN which is dense in the unit ball of C(X) (C(X) being 
the space of all real valued continuous functions on X). Consider the function 
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which takes values in B = £°°(N). For any invariant measure /z e A^inv, define 



It is clear that Ai,^{a) — {fJ-}- Then the variational principle implies htop{X^{a)) = 
hij,. This finishes the proof because X^{a) is nothing but G^. □ 

5. An EXAMPLE: RECURRENCE IN AN INFINITE NUMBER OF CYLINDERS 

We have got a general variational principle. In order to apply this principle, one 
of the main questions is to get information about the convex set M.<^[a, E) and the 
maximal entropy measures contained in it and to compute the maximal entropy. 
Let us consider the symbolic dynamical system ({0, 1}^, T), T being the shift. The 
structure of the space Alinv is relatively simple. To illustrate the main result, we 
shall consider a special problem of recurrence into a countable number of cylinders. 

5.1. Symbolic space. 

Let X = {0, 1}^ and T be the shift transformation. As usual, an n-cylindcr in 
X determined by a word w = XiX2 • • • a;„ is denoted by [w] oi [xi, • ■ ■ , Xn]- For any 
word w, define the recurrence to the cylinder [w] of x by 



if the limit exists. 

Let W = {wi}i^i with / C N be a finite or infinite set of words. Let a = 
{ajjjg/ be a sequence of non-negative numbers. We are interested in the following 
recurrence set 

Ria; W) = {xeX : R{x, [wi]) = ai for all i G /} 

whose topological entropy will be computed by the variational principle which takes 
a simpler form. 

Corollary 5.1. We have /itop(-R(a; W)) = max^g_v((a.w) ft-^ where 



Remark that the shift transformation on the symbolic space is expansive. Thus 
the entropy function /i^ is upper semi-continuous ([30], p. 184). Hence we can 
obtain the supremum in Corollary 5.1. 

Recall that any Borel probability measure on X is uniquely determined by its 
values on cylinders. In other words, a function fj, defined on all cylinders can be 
extended to be a Borel probability measure if and only if 



a = 





M{a,W) = {/i G Minv ■■ m(K]) 



ai for all z G /} . 




and 
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The entropy hf^ of any invariant measure /x S Aiinv can be expressed as follows 

= ji- ^ • • • , ^n]) log 

The sum in the above expression which we will denote by h'jT^ is nothing but a 
conditional entropy of n and it is also the entropy of an (n — l)-Markov measure 
which tends towards /i as n goes to oo. 
A Markov measure of order k is an invariant measure v G A^inv having the 
following Markov property: for all n > A; and all {x\, - ■ ■ , x„) € {0, 1}" 

u{[xi,--- ,Xn-l]) vilXn-k,--- ,Xn-l])' 

A Markov measure of order k is uniquely determined by its values on the (k + 1)- 
cylinders. The preceding approximating Markov measure fin has the same values 
as /i on n-cylinders. 

To apply the above corollary, we have to maximize the entropy /i^ among all 
invariant measures /x with constraints l^{[wi]) = Ui for i G I. The entropy is 
a function of an infinite number of variables n{[w]). So we have to maximize a 
function of an infinite number of variables. However, in some cases it suffices to 
reduce the problem to maximize the conditional entropy which is a function of a 
finite number of variables. 

Denote by the length of the word w. Let W„ := {w E W : \w\ < n} and 
Ai{a.,Wn) ■— {a* G -Minv ■ = di^Wi G Wn}. Let 12* be a maximal entropy 

measure over A1(a, W) and /i* be the (n — l)-Markov measure which converges to 
fj,*. Let /i^"^ be a maximal entropy measure over A4{a,Wn)- Then 

hn* = lim /i„. < lim inf h m < lim sup h (n) < ha* . 

Hence 

lim /),,(„) = ha* = max ha- 

However, for any measure ^ G A1(a, >V„), we have — h^^ — h^f^K where /i„ is 
the (n — l)-Markov measure which converges to /x ([16]). Thus, is the maximal 
point of the conditional entropy function h^T^ . 
Thus we have proved the following proposition. 

Proposition 5.2. The maximal entropy over M{a.,W) can be approximated by the 

maximal entropies over A^(a, W„) 's. 

5.2. Example: Frequency of dyadic digital blocks. 

Let us consider a special example: 

W = {[0],[02],... ,[0"],...} 

where O'' means the word with repeated k times. 

Theorem 5.3. Let W = {[0"]}„>i and a = {a„}„>i C M+ . We have 
(a) R{a; {[0"]}„>i) ^9 if and only if 

1 = ao > ai > a2 > . . .; a, - 2ai+i + 0^+2 > (i > 0). (5.1) 
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(b) // the above condition is satisfied, then 

oo 

htop{R{a; W)) = -h{l - ai) + " ^a^+i + ai+2) (5.2) 



i=0 



where h{x) = —x\ogx. 



The proof of the above theorem is decomposed into several lemmas which actually 
allow us to find the unique invariant measure of maximal entropy and to compute 
its entropy. 

Let jjL be an invariant measure. The consistence and the invariance of the measure 
imply that we may partition all (n + 2)-cylinders into groups of the form 

{[OwO], [Owl], [IwO], [Iwl]} 

such that the measures /^([OwO]), ^([Owl]), /^([IwO]), ^([Iwl]) are Hnked each other 
through the measures /u([Ow]), ^([wO]), ^([wl]), /x([l'u;]) of {n + l)-cyHnders. More 
precisely, if we write Pw = ndw]), then for any word w of length n, we have 

POwO + POwl = POw 

PlwO + Plwl = Plw 

POwQ + PlwO = PwO 

POwl + PUvl = Pwl 

Lemma 5.4. Suppose fi G A4{a, W). //w = 0" with n>0, we have 

P00"0 = an+2 (5.3) 

poo"i = an+i - a„+2 (5.4) 

PiO"0 = - a„+2 (5.5) 

PiO"! = a„ - 2a„+i + an+2- (5.6) 

Proof. The relation (5.4) is a consequence of the consistence 

and the facts poo" = oin+i and poco = cin+2', the relation (5.5) is a consequence of 
the invariance 

PlO"0 + POO^O = P0"0 

and the same facts; to obtain the relation (5.6) we need both the invariance and 
the consistence: 

PlO"l +P00"1 = PO"! =P0" -P0"0. 

Then by (5.4) we get 

PWl = PO" — P0"0 — POO"! = 0"n — ^^n+l + O.n+2- 

□ 

Let a, b, c be three positive numbers such that a + b>c. Consider the function 
F{t, u, V, w) = h{t) + h{u) + h{v) + h{w) (5.7) 
defined on where h{x) = —a; log a;. 
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Lemma 5.5. Under the condition 

t + V = a, u + w = b, t + u = c 
the function F defined by ( 5. 7) attains its maximum at 

ac be a{u + h — c)) bia + b — c) „\ 

t^ 7, U= -, V= ; , W= ; . (5.8) 

a + b a + b a + b a + b ^ ' 

Proof. From the condition we may solve t, u, v as functions of w. 

t = c — b + w, u = b — w, v = a + b — c — w. 
So, maximizing F{t, u, v, w) under the condition becomes maximizing the function 

F{w) = h{c - 6 + w) + h{b - w) + h{a + b - c - w) + h(w) 
which is strictly concave in its domain. Since h'(x) = — 1 — logx, wc have 
F'{w) = — log(c — b + w) + log(6 — w) + log(a + 6 — c — w) — log w. 

Solving F'{w) = 0, we get w = ^^^^^pg-^. The corresponding t, u, v are as announced 
in (5.8) □ 

Lemma 5.6. Suppose that {an}n>o is a sequence of real numbers such that 

1 = ao > ai > a2 > . . .; ai - 2ai+i + 0^+2 > {i> 0). (5.9) 
There exists an invariant measure n such that if w is not a block of 's, we have 
p^^^, = Pl}^ (Ve,e'G{0,l}). (5.10) 

Pw 

The above recursion relations (5.10) together with (5.3-5.6) completely determine 
the measure /x, which is the unique maxim,al entropy measure among those invariant 
measures v such that j/([0"]) = a„ for n > 1. 

Proof. For any /imA1(a, W), wc must have /i([0]) = oi and /-*([!]) = 1 — ai. By 
Proposition 5.2, we are led to find the measure /x^""'"^) which maximizes /i^"^^'' for 
each n > 0. Let fj, be an arbitrary invariant measure in A4{a,Wn+2), n > 0. We 
identify fi with the sequence Pw = ^{[w]) indexed by finite words. By Lemma 5.4, 
we have 

Po = ai, pi = 1 - ai 

Poo = a2, Poi = Pio = ai - 0,2, pn = l-2ai+a2 

So, we have 

= /j(^2) + 2h{ai - 02) - h{ai) - h{l - oi) + h{l - 2ai + a2). (5.11) 

Let us now consider the conditional entropy /i^"^^^ for n > 1, which is a function 
of /i-mcasurcs of (n + 2)-cylindcrs, whose general form is [eu;e'] with w a word of 
length n and e, e' S {0, 1}. If w = 0", by Lemma 5.4, the measures of the four 
cylinders [eO"e'] with e, e' G {0, 1} are determined by {afc};c>i. If w ^ 0", the four 
quantities Pewe' are linked to each other by 

POwO + POwl = POw, PlwO + Plwl = Plw, POwO + PlwO = PwO 

through measures of {n + l)-cylindcrs: a := pwO, b := piw, c := pow Consider the 
four measures Pewe' as variables, there is only one free variable and three others are 
linked to it. Thus to any word w 7^ 0" of length n is associated a free variable. 
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In fact, ft,^"'*'^'' is the sum of all terms 



-J2Pev.e'log^ {w€{0,ir) (5.12) 



If w = 0", the corresponding term (5.12) is a constant depending on the sequence 
{o„} (see Lemma 5.4). li w ^ 0", there is a free variable in the term (5.12). So, 
maximizing /i^""*"^^ is equivalent to maximizing all above terms, or equivalently to 
maximizing 

-^Pewe''^OgPewe'- (5.13) 

Applying Lemma 5.5 to the above function in (5.13) provides us with the maximal 
point /i^""*"^^ described by (5.10) with \w\ = n. It is easy to check that the family 
{Pw) defined by (5.3-5.6) and (5.10) for all words w, verifies the consistency and 
the invariance conditions. The measure determined by the family is the unique 
measure of maximal entropy and is its (n + l)-Markov measure. □ 

Lemma 5.7. The entropy of the invariant measure /i of maximal entropy deter- 
mined in the above lemma is equal to 

oo 

hfj. = -h{l - ai) + ^/i(aj - 2aj+i+j+2) 

3=0 

where h{x) = —a; log a;. 

Proof. Recall that for any invariant measure /x we have 

/lu = lim = inf /iL") 



where 



Thus we may write 



|,„|=„-1 e=0,l 



For n > 0, write 

Ptwfi' , PeO" 



\w\=n e,€' e,e' 

= :7i(n)+/2(n) (5.15) 

where J2' means that the sum is taken over w ^ 0" {0^ meaning the empty word 
so that /i(0) = 0). When n = 0, we get 

= /j(qj2) + 2h{ai - a2) - h{ai) - h{l - ai) + h{l - 2ai + 02). (5.16) 

This coincides with (5.11). 
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Suppose n > 1. By the recursion relation (5.10), we have 
I I / P''i> 

\w\=n €,€' 



PO" 



= - Y] y]p««e' log + VpeO»e' log 

\w\ = n e,e' e,e' 

= + /3(n) (5.17) 

where 

-^3 {n) = ^ P€0"e' log . 

From (5.15) and (5.17) we get 

^(n+2) _ /j(n+l) ^ ^ j^^^y ^518) 

On the one hand, by using the invariance and the consistence we can simplify as 
follows 



h{n) = ^po"£'log- 



Par. 

t 

= ^PO^e' logPO"e' - PO" logPO" 
e' 

= a„+i loga„+i + (a„ - a„+i)log(a„ - a„+i) - a„loga„. (5.19) 
On the other hand, we have 

h{n) = - ^PeO«e' logPeO"e' + ^ PeO-^ logPcO" 

= -a„+2 loga„+2 - 2(a„+i - a„+2) log(a„+i - a„+2) 
-(a„ - 2a„+i + a„+2) log(a„ - 2a„+i + a„+2) 
+a„+i loga„+i + (a„ - a„+i) log(a„ - a„+i). (5.20) 
By combining (5.18), (5.19) and (5.20) we get 
^(n) := _ ;,(n+i) 

= [/i(a„+2) - 2/i(a„+i) + /i(a„)] + 2[/i(a„+i - a„+2) - /i(a„ - a„+i)] 
+h{an - 2o„+i + a„+2). 
Finally using (5.14) we get 

oo oo 

Tl=l j=0 

□ 

Remark that the measure of maximal entropy in R{a, W) is not necessarily er- 
godic. Here is an example. If o„ = a (Vn > 1) is constant, then there is a unique 
invariant measure in M.{a, W). which is aS^ + (1 — a)5i. In this case, R{a, W) is not 
empty but of zero entropy. Notice that i?(a, W) contains no point in the support 
of the unique invariant measure. If a = i, R{\, W) contains the following point 

01001100011100001111... 

(The terms in the two sequences {0*^} and {l'^} are alternatively appended.) 
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We thank the referee for telhng us that Pfister and SuUivan [25] also obtained 
the same result as our Theorem 1.1 but with a different method. 
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